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Abstract. A single inhibitory neuron with delayed feedback is considered. The neuron receives an excitatory input 
from the Poisson stream, and inhibitory impulses from the feedback line with delay. We investigate here, how does 
the feedback presence affect the output firing statistics of inhibitory neuron. Using binding neuron (BN) as a model, 
we derive exact analytical expressions for the output interspike intervals (ISI) probability density, mean output ISI and 
coefficient of variation as functions of model's parameters for the case of threshold 2. Using leaky integrate-and-fire 
(LIF) model, as well as BN model with higher thresholds, these statistical quantities are found numerically. In contrast 
to the previously studied situation of no feedback, the ISI probability densities found here both for BN and LIF neuron 
become bimodal and have discontinuity of jump type. Nevertheless, the delayed feedback presence was not found to 
affect substantially the output ISI coefficient of variation. The ISI coefficient of variation found ranges between 0.5 
and 1. It is concluded that introduction of delayed feedback can radically change neuronal output firing statistics of 
inhibitory neuron. This statistics is as well distinct of what was found previously for excitatory neuron with delayed 
feedback. 
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General theory and mathematical aspects 



1 Introduction 

A realistic neuronal network is normally characterized with a 
complicated system of excitatory and inhibitory interconnec- 
tions between individual neurons the network is composed of. 
Statistics of spiking activity of individual neurons can be mea- 
sured experimentally |7, 10, 13|. It would be interesting to un- 
derstand how the details of network's construction might influ- 
ence statistics of neuronal activity, when the network is driven 
with some stimulation, or allowed to reverberate freely. Exact 
theoretical analysis of this question in a developed network rep- 
resents fair mathematical difficulties. 

At the same time, in a real neural network, constructing el- 
ements can be found, which allow exact mathematical treat- 
ment. The results of such a treatment can shed light on the 
nature of transformations the neuronal activity might undergo 
while spreading within a real neural network. One example is 
an excitatory neuron which sends its output impulses onto its 
own dendritic tree. This type of constructive element has been 
found in the olfactory bulb [1 8|. Theoretical study of this con- 
struction fed with Poisson stream revealed interesting peculiar- 
ities in its output activity statistics |20|. Another natural variant 
of this construction is an inhibitory neuron with feedback. It 
seems that selfinhibition happens more frequently in the brain, 
than selfexcitation. Selfinhibition can be slow, due to potas- 
sium channels opening ||3|, or fast, due to chlorine channels IJl 
121. It also can be direct (through autapses) ll2ll8lfT2^. or acting 



through a single intermediate neuron f9l. Also, it can be evoked 
not only by means of spike delivered to corresponding synaptic 
connection, but also through extended diffusion of some usual 
[12], or unusual 1,3J mediator. 

In this paper, we consider situation of inhibitory neuron 
fed externally with excitatory impulses from Poisson stream 
of intensity A, which sends its output impulses to its own input 
through feedback line with delay time A . The inhibition mecha- 
nism is fast in a sense, that it cancels excitatory impulses, which 
neuron obtained recently, and has no any effect on the neuron 
in its resting state. 

For analytical derivation, we take binding neuron (BN) as 
a neuronal model, see Sec. 12. II for BN definition. In Sees. [3]- 
|6] we derive exact analytical expressions for the output ISI 
probability density, mean output ISI and coefficient of varia- 
tion as functions of X, A and BN's internal memory, T, for BN 
with threshold 2. In Sec.|7] these statistical quantities are found 
numerically by means of Monte-Carlo simulations for leaky 
integrate-and-fire (LIF) model, as well as for BN model with 
higher thresholds. In contrast to the previously studied situa- 
tion of neuron without feedback, and of excitatory neuron with 
delayed feedback, the ISI probability densities found here both 
for excitatory BN and excitatory LIF neuron are bimodal. Also 
they retain discontinuity of jump type obsereved before for the 
excitatory neuron with feedback. In the case of instantaneous 
(A = 0) feedback, as it could be expected namely for fast shunt- 
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ing inhibition, the feedback Hne has no effect on the output ac- 
tivity of inhibitory neuron. 



2 Object definition 

2.1 BN without feedback 

The binding neuron model |16| is inspired by numerical sim- 
ulation 1 15 1 of Hodgkin-Huxley-type point neuron, as well as 
by the leaky integrate-and-fire (LIF) model 1 1 1 1. In the binding 
neuron, the trace of an input is remembered for a fixed period of 
time after which it disappears completely. This is in the contrast 
with the above two models, where the postsynaptic potentials 
decay exponentially and can be forgotten only after triggering. 
The finiteness of memory in the binding neuron allows one 
to construct fast recurrent networks for computer modeling as 
well as obtain exact mathematical conclusions concerning fir- 
ing statistics of BN. Recently, the finiteness is utilized for exact 
mathematical description of the output stochastic process if the 
binding neuron is driven with the Poisson input stream in the 
case of no feedback fTSl, for BN with instantaneous feedback 
lfT9J and for excitatory BN with delayed feedback ll20ll . 



where yi{t) are defined according to the following recurrent re- 
lation: 



'■+1 



y,{t)=yi-i{t) + -^{t~ny+'e-'~'~^{t-nye-'~', 



{i+iy. • ■ v. 

yQ{t) = e-^'X^t, / = 0,1,..., f>0. 



(2) 



P^{t) is a unimodal function, which reaches its maximum at 
min(j;T). Example of P^{t) is given in Fig.|9] left. 

The first moment, Wf , of the probability density ([TJ was 
found as 



<.f,/*(,)*4(2 + pjJ-^ 



(3) 



which will be used later. 

In this work, we also utilize the probability n{t) to get an 
output ISI, which is longer than t: 



n{t) = / p'^it) dt. 



(4) 



The exact expression for i7(f ) for an arbitrary t, which is cum- 
bersome, can be found in 1 17|. We will need the expression for 
n{t) only at the domain f < T, where it reduces to the following 



n{t) = {I + It) e 



-It 



t < T. 



(5) 
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Fig. 1. Binding neuron with feedback (see 1161 for deatils). T is sim- 
ilar to the "tolerance interval" discussed in f6' p. 42]. Multiple input 
lines with Poisson streams are joined into a single one here. 



The BN works as follows (see Fig.[T]with the feedback line 
removed). All excitatory input impulses have the same magni- 
tude. Each one of them is stored in the BN for a fixed period 
of time, T, and then is forgotten. When the number of stored 
excitatory impulses, L, becomes equal to the BN's threshold, 
A^o. the BN fires output spike, clears its internal memory, and 
is ready to receive fresh inputs. Thus, the state just after firing 
corresponds to the resting state of excitable membrane in real 
neurons, and presence of impulses in the internal memory of 
BN corresponds to partially depolarised state. In this work, we 
take BN with Aq = 2 for analytical derivation. BNs with higher 
thresholds are studied numerically in Sec. [T] 

Normally, any neuron has a number of input lines. If input 
stream in each line is Poissonian and all Unes have the same 
weight, all of them can be joined into a single one, like in Fig.lT] 
with intensity. A, equal to sum of intensities in the individual 
Unes. 

The output statistics for BN without feedback was calcu- 
lated if Ao = 2 (see |18| for details). ISI probability density 
function, P'^{t), where f > denotes the output ISI duration, 
was obtained as 



2.2 Feedback line action 

In this work, we consider the situation, when BN receives ex- 
citatory input from the Poisson stream and inhibitory impulses 
from the feedback line. 

We assume, that time delay A of impulse in the feedback 
line is smaller than the BN's memory duration, t: 



A <T. 



(6) 



niT <t < (ot+1)t 



P\t)^y„,{t), m = 0,l, 



(1) 



It allows to make analytical expressions shorter. Also, the as- 
sumption ^ is consistent with the case of direct feedback, not 
mediated by other neurons. 

If the line is empty, when neuron fires, an output impulse 
enters the line and after delay A reaches neuron's input. If the 
line already keeps an impulse at the moments of BN firing, 
it does not accept the new one. It means, that at any given mo- 
ment, the feedback line either keeps one impulse, or conveys no 
impulses, and cannot convey two or more impulses at the same 
time. If so, the state of the feedback line can be described with 
a single variable. For this purpose, we introduce the stochastic 
variable s, s g]0;A], which gives the time to live of the impulse 
in the feedback line, see Fig[T] Hereinafter, we will use the val- 
ues of s just at the moments of output ISI beginings (just after 
BN firings). 

The inhibitory action of feedback impulses is modelled in 
the following way. When the inhibitory impulse reaches BN, 
it annihilates all excitatory impulses already present in BN's 
memory, similarly as C/-type inhibition shunts depolarization 
of excitable membrane. If at the moment of inhibitory impulse 
arrival, the BN is empty, then the impulse desappears without 
any action, similarly as C/-type inhibition does not affect mem- 
brane's voltage in its resting state. Such inhibition is "fast" in 
that sense, that the inhibitory impulses act instantaneously and 
are not remembered by neuron. 
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3 Derivation outline 

It is clear, that both the binding neuron and the feedback line 
operate in deterministic manner Nevertheless, the probabilis- 
tic description is required for the output stream because of the 
stochastic nature of driving Poisson process. 

Let us denote by P^ (f ) the ISI probability density function 
for inhibitory neuron with delayed feedback. In order to calcu- 
late P^ (f ), we use the procedure, previously utilized for excita- 
tory BN with delayed feedback f^Ol. As a first step, we define 
the conditional probability density, f"^ (f \ s). Namely, P^ {t \ s) 
gives the probability to obtain an output ISI of duration within 
interval [t;t + dt[, provided there was an impulse in the feed- 
back line with time to live equal s at the moment of this ISI 
begining. 

Then, we introduce the stationary probability density, f{s), 
for time to Uve, s g]0;4], of an impulse in the feedback line at 
the moment of beginning of any output ISI. 

The output ISI probability density can be calculated based 
on the expressions for P^ (f | s) and f{s), namely: 



P\t) 



P^{t\s)f{s)ds. 



(7) 



In order to find f{s), we first obtain the transition proba- 
bility density P{s' \ s), s,s' e]0;4], which gives the probability 
that at the begining of some output ISI, the line has impulse 
with time to live within interval [s'\s' +ds'[, provided that at 
the beginning of the previous ISI it had impulse with time to 
live equal s. f{s) is then found as normalized to 1 solution of 
the following equation: 



P{s'\s)f{s)ds^f{s') 



(8) 



In the next section, we are going to find explicit expressions 
for probability densities P'^ {t \ s), P{s' \ s) and f{s). 



and is firstly triggered at moment t. These events are indepen- 
dent since their realizations are defined by behavior of Poisson 
input stream on disjoint intervals ]Q',s\ and ]s;t\. By definition 
of n(f ), see Eq. (JDl, the probability to have (i) is n{s), and (ii) 
has the probability P^{t — s)dt. Therefore, 



p^{t\s)^n{s)p'^{t^s), t>s. 



(10) 



The conditional probability density P'^ {t \ s), given in (|9]l and 
(fTOb . is normalized: J^P'^it \ s)dt = 1. 

Taking into account Eq. (|5]l, ^ and (fTOl i for the case A < T 
one obtains P^ {t \ s) as follows: 



A^fe-^', te]0;s[ 



P^{t\s) = 



(11) 



{l+Xs)e-'"'P^{t-s), t>s. 
P^ {t \ s), given in ( fTTT i. has a break of height X^s e^ Sitt — s. 

4.2 Transition probability density P{s' \ s) 

From the meaning of P^ {t \ s) it follows that Eq. (|9]i allows to 
calculate P{s' \ s) for s' < s, namely: 

P{s'\s)=P'^{s-s'\s)^P°{s-s'), s'<se]0;A]. (12) 

As the feedback line conveys no more than one impulse at 
any given moment, it is impossible to have s < s' < A. There- 
fore, 

P{s'\s)^Q, s<s'<A. (13) 

Consider the exact equality i' = Zi . It is realized every time, 
when for previous ISI t > s, and this inequality happens with 
non-zero probability. Therefore, the probability density P{s' \ s) 
has singularity of 5-function type ats' = A. For calculating its 
mass, one should obtain the probability of t > shy integrating 
Eq. ( [Tol l over suitable values of f : 



4 Main calculation 

4.1 Conditional probability density P'^{t \ s) 

In order to derive P^ {t \ s), domains t < s and t > s should be 
considered separately. 

In the case t < s, the output impulse must be generated 
without the line impulse involved. Therefore, probability den- 
sity for such ISI values is the same as for BN without any feed- 

P^{t\s)^P'{t), t<s. (9) 

Here P'^{t) is the output ISI probability density for BN without 
feedback, given in Eq. ([T]i- 

At the moment s, the inhibitory feedback impulse reaches 
BN and BN becomes empty. As it is impossible to obtain more 
than one impulse from the Poisson stream within infinitesi- 
mally small time interval [s; s + dt [, P^ {t \s) —Q when t — s. 

In order to obtain ISI f > ^, two independent events must 
occure: (i) BN without feedback fires no spikes during time in- 
terval ]0\s\; (ii) BN without feedback starts emty at moment ,s- 



[t s) 



P{s'\s)^8{s' -A) I dtp 

S 

oo 

^5{s' -A)-n[s) jp^{t-s) 



dt 



= n{s)5{s' -A), s'>s(^\Q;A]. (14) 

oo 

Here we use /P''(f)<if = 1. 

The transition probability density P{s' \ s), given in Eqs. (fTZb 

- (O is normalized: Jo"* P{s' \ s)ds' = 1. 

Note, that Eqs. ( fTSl i and ( fT4l l could be obtained directly, 
without refering to P^ (f \ s). Indeed, if s' < s, then the ISI t = 
s — s' was obtained without feedback line envolved. Therefore, 
P{s' I s) is determined by probability to obtain ISI of duration t 
from BN without feedback, which gives (fT2l l. 

The exact equality s' — 4 is realized when BN without 
feedback fires no spikes at ]0; s]. The probability of this event 
is n{s), which gives (fT4l i for conditional probability density. 
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, A ^3u 9H ^.^L.^ '2l ^_^ t 

A"^ r + A2r 2t + A 

Fig. 2. Domains off used for calculating integral in l |19t . 

Substituting P^{s — s') from ([T]i and n[s) from (|5]l, one ob- 
tains P{s' I s) for the case 4 < T in the following form: 



'e-A(.v-.v');t2(i-s'), s>s' ^]Q\A], 
{Xs+\)e-^' 5{s'~A), s'>s. 



ns\s) = {:,^, ,;:x;,; :: " rc"^' ds) 



Interestingly, that obtained expressions for P{s' \ s) are the 
same, as those, previously found for excitatory BN with de- 
layed feedback IIqI. 
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Fig. 3. Example of ISI probability density function, calculated in ac- 
cordance with Eqs. l l20t . l i23t . l l24t . left, and numerically, by means of 
Monte Carlo method, right. For both panels: T = 10 ms, 4 = 8 ms, 
A = 10 s^', A'o = 2. Curve found numerically fits perfectly with one 
shown in the left panel. In the numerical experiment 10^ spikes were 
produced. 



4.3 Delays probability density 

In order to find f{s), one should substitute P{s' \ s) from (fTSl l 
into ^ and solve the obtained equation. As P{s' \ s) obtained 
is exactly the same as for excitatory BN with delayed feedback 
||20J . the equation for f{s) and f{s) itself will also be the same. 
In II20I . the probability density f{s) was obtained as 



f{s)^a5[s^A)+g{s), 



(16) 



where g{s) - is an ordinary function, which vanishes out of 
interval ]0; 4]: 



K.) = ^(. 



-2X(A- 



and a - is a dimensionless constant: 
a = 



(2Azi+3)e2^'^ + r 



s^]Q;A], (17) 



(18) 



which gives the probability to find the impulse in the feedback 
line with time to live A at the beginning of arbitrary ISI. 



5 ISI probability density 

In order to find P^ (f ), one should substitute ( fTTT i and ( fTSI l into 
Eq. (|7]i, which gives: 

P^{t)=aP^{t\A)+ f^P^{t\s)g{s)ds. (19) 

Jo 

As the explicit expressions for P^ [t \ s) are different for differ- 
ent domains of t (see Eqs. ( fTTT l and ^), further transformation 
of (fT9T l depends on the domain, the t belongs to. The first few 
domains off are shown in Fig.|2] 

Consider case A, where t £]Q;A[. Here integration domain 
in (fT9] l should be splitted into two with point s — t, see both top 
and bottom line of Eq. (fTTT l. This gives 



which after transformations becomes 
2A e-^' 



P\t)^ 



2XA+3+e 



-2XA 



IaV-IaV- 

6 2 



-Xt 



{I + ie-2^^ + ^e-2A(/i-0) +X^tA\ , t<A. 



(20) 



P^(f)= / {l+Xs)e-^'X\t-sy 
Jo 

rA 



/A 
Xhe-^'g{s)ds+ aXh e' 



Xt 



When t >A, one needs only the bottom line of Eq. ( fTTT l to 
calculate P^{t), and Eq. ( fT9T l turns into the following: 

P^(r) = fl(l +A4) e-^'^F^(t-A)+ 

+ (^{\+Xs)e-^'P°(t-s)g{s)ds. 
Jo 

Let us introduce a new variable of integration, u = t — s: 

P^{t) ^a{l+XA) e-^'^P^{t-A) + 

+ [ {\+X{t-u))e-^^'-"^P'^{u)g{t-u)du. (21) 

Jt-A 

In order to perform integration in ( f2TT l. we define two groups of 
domains, B,„ and C„,, namely: 

B,n= [mx + A;{m+\)x], m==0, 1,..., 

C,„ =: ]{m+\)T,{m+l)x + A[, m==0,l,.... 

Note, that the full domain [4 ; 0° [ is completely covered by al- 
ternate domains B„, and C„,, m = 0, 1 , . . .. 

If t G B,,,, then mT < f — 4 < f < (m + 1 )t, and one should 
substitute y,„{t) from (|2]i, corresponding to that m, instead of 
P^{u) in the ^^. If t e C,„, then inx <t- A < {in + 1)t < f. 
Therefore, the domain of integration in the Eq. ( f2TT l should be 
split into subdomains two with point (m-|-l)T, andasP'^(M) one 
should substitute either y„,(f), ory,„_)_i(f) depending on subdo- 
main. 

5.1 ISI probability density at the domains £„, 

Thus, in the case t G B,„, one obtains for P^ (t): 

P^(t)^a(l+XA)e-^'^y,„{t^A)+ 

+ [ (l+Xs) e-^'ymit - s)gis)ds, t G B„, (22) 
Jo 
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which after integration gives: 

P^(t) = a{\+XA)e-^^-yr„{t-A)- 



m+1 k 



'^-^e-^'l^l^K,tX'-'{t-{k-l)T 



\k-l 



k=\ l=Q 
k=ll=0 
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„ 1 m k 

^.-^'^^/r„A'^-'(f-fcT)^-', fGB,„, (23) 



where 



^kl — 



^ ^ ' + ^ .(-2A4)'+2 + /+l- 



2'+2(fe-Z)! V(/ + 2)! 



-(/-i).-^^-2i:(-2^^)"'^- '+1 



eo (^-0 



!=0 



/ + 1 - i 



■Azi 



5.2 ISI probability density at the domains Cm 

Consider the case t ECm- Taking into account Eqs. ([T]l and (|2|, 
one can rewrite (1211 1 as follows 



P^{t) 



,-A4. 



t-{m+l)z 







= a{l+XA)e-'^''y,„{t-A)+ 
(1 + Ai) e-^'y„+i [t - s)g{s)ds+ 



+ [ il+Xs)e-^'y,„{t-s)g{s)ds^ 

Jt-(m+\)T 

a{\+XA)e-^^y,^{t-A)+ [ (l+Xs) e-^^'y^it ^s)gis)ds- 

^— — .-^' / {l+Xs){t-s~{m+l)zr+^g{s)ds- 

{m + 2)\ Jo 

T—U\' / {l+Xs){t-s-{m+l)xr+'g{s)ds. 

(m+lj! Jo 



Fig. 4. Le/f - Mean output firing rate as the function of A for inhibitory 
BN with delayed feedback (1), for BN without feedback (T9| (2) and 
for excitatory BN with delayed feedback 1201 (3), obtained analyti- 
cally. Curves (l)-(3): A'o = 2, T = 10 ms. 4 = 2 ms both for (1) and 
(3). Right - Mean output firing rate as the function of A for inhibitory 
BN with delayed feedback for Nq = 2 (1), obtained analytically, and 
for A'o = 4 (2) and A'o = 6 (3), found numerically. Curves (l)-(3): T = 
10 ms, A —2 ms, 1 ■ 10* triggerings for each point. 



Here the dimentionless variable of integration v = Xs was in- 
troduced. 

Performing integration in ( 1251 ) one obtains: 

m+4 m+3 

p^,{x)^l^Kix'^e-^^^+^-^-l^D,x\ (26) 

/=0 /=0 

where 



^, = fe^^-^^^ 1^0,.. .m+l- 



K, 



2in+4-l . I [ 
1 



m+2 



-2A.A 



1 



4- (m + 2)! (m + 2)!' 

1 



"i+? i-iyt 



,tt (m + 2-0! (/+!)! (m + 3)!' 
_'"+2 (-!)'(/+ 1) . 

-Km+4 — 2-1 



It is useful to denote as Pg,„{t) the righthand side of Eq. 
defined for all t: 

Pim{t)^a{\+XA)e-^^ym{t^A)+ 

+ / {\+Xs)e-^'y„{t-s)g{s)ds, t>Q 
■Jo 

With this notation, one obtaines: 

P^it) 



,eo(m + 2-/)!(/ + 2)!' 

1 '(-!)'-• -(m-l-i) 

^- = 2^^-g ; /!(^/)! ' ^-0,...m+l; 



^'"+'"4 Jj/!(m + 2-/)!' 
_1''^^ (-1)' 



(27) 



'GC,„ 



<„(0 + Y ^"^' •'^'« (^ (' - (fn+m) , (24) 



Note, that in the case 4=0, ISI probability density is com- 
pletely defined by Eq. (l23T l. which turns into 



where 



^'"«^l(;;^/(^+^')(^-^')""Kx)^- 



P^{t)U=o^P^(t), t>0. 



(28) 



■(;;^/(^+^')(--^')'""Ki)^^'' 



m = 0, 1,. 



(25) 



This indeed should be the case, because when A —0, inhibitory 
impulses always enter empty neuron and, therefore, the feed- 
back line have no chance to affect the output stream. Naturally, 
the output ISI distribution for 4=0 coincides with that found 
for BN without feedback. 

Graph of P^ (f ) is shown in the Fig. [3] 
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Fig. 5. Left - Coefficient of variation vs. x = At for inhibitory BN 
with delayed feedback for 4 = 2 ms (1), 4 = 5 ms (2), obtained 
analytically, and for 4 = 20 ms (3), found numerically after 10^ 
triggerings for each point. For curves (l)-(3): A'o = 2, T = 10 ms. 
Right - Coefficient of variation vs. x = Xx for inhibitory BN with 
delayed feedback for Nq = 2 (1), Wq = 4 (2) and A'o = 6 (3), found 
numerically after 10 triggerings for each point. For curves (l)-(3): T 
= 10 ms, 4 = 18. 



6 Properties of the ISI probability density 

6.1 Mean interspike interval 

The mean output ISI, W^, can be defined as the first moment 
of the ISI probability density: 



Fig. 6. Left - Coefficient of variation vs. A for inhibitory BN with de- 
layed feedback (1), for BN without feedback 1191 (2) and for excita- 
tory BN with delayed feedback 1201 (3), obtained analytically. Curves 
(l)-(3): A'o = 2, -r = 10 ms. /i = 2 ms both for (1) and (3). Right - 
Coefficient of variation vs. X for inhibitory LIF neuron with delayed 
feedback (1), for LIF neuron without feedback (2) and for excitatory 
LIF neuron with delayed feedback (3), found numerically. Curves (1)- 
(3): C = 20 mV, Tm = 3 ms, jjq = 15 mV, 1-10^ triggerings for each 
point. 4 = 2 ms both for (1) and (3). 



W^= / tP^{t)dt. 



Taking into account Eq. (|7]i, one obtains: 

Wf = / tdt [ P^{t\s)f{s)ds^ [ dsf{s) [ tP'^{t\s)dt, 



which taken together with Eq. ( fTTT i gives: 



W^= / dsf{s)\ t^e-^'X^dt+ 



+ {l+Xs)e-^' ftP^{t~s)dt\ = 

s ' 

A 

= jf dsfis) (2 + e-^' (A< - 2 + (A< - 1 ) Xs) 



where W^ is the mean output ISI for BN without feedback, 
Eq. (O. Use here (fTSI l and (fTTb . which gives after transforma- 
tions: 

Wf=a{A+wl^), (29) 

where a is given in ( fTSb . 

Note, that in the case A —0 Eq. ( |29] | turns into the follow- 
ing: 



Wt\A=0- 



W 



1 ) 



which is consistent with Eq. 

Output intensity, Xo, defined as the mean number of im- 
pulses per time unit, is inversed W^ : 



,4_ 1 _ (2A4+3+e-2A4)(i, 



-A.r\ 



wf 



4-{XA+2-{XA + l)e-^^) 



■X. 



(30) 



where Eqs. ( |29] |, (O and ( fTSl ) are used. At large input rates the 
following relation takes place 



A^oo 12 " / 44 



(31) 



This limiting relation can be understood as follows. At moder- 
ate stimulation some input spikes are lost without influencing 
output due to high probability of long input ISI. At high in- 
tensity every two consecutive excitatory input impulses trigger 
the BN and send impulse into the feedback line, provided it is 
empty. Thus, output intensity should be A/2 minus firing, in- 
hibited by the line. The maximum rate of ihibitory impulses, 
which can be delivered by the feedback line to the neuron's 
input, is 1/4, and this rate is attaining when t ^ °o. Each in- 
hibitory impulse either cancells one excitatory impulse in the 
neuron, or does nothing, if neuron appears empty at the mo- 
ment of the feedback line dejection. For high input rates, the 
probabilities to find neuron empty, or storing one impulse are 
both approahing 0.5. Thus, due to feedback line activity, about 
22- excitatory impulses will be eliminated from input streem, 
and about half as much from the output stream, which explaines 

(EB- 

Graph of X^f is shown at the Fig.lD 

6.2 CoefFlcient of variation 

The coefficient of variation (CV) c^ of output ISIs is defined 
as dimentionless dispersion: 



Wo^ 



{wfy- 



1, 



where W2 is the second moment of the ISI probability density: 



t^P'^{t)dt^f dsf{s)f t^ P'^{t\s)dt. 
Jo Jo 

While calculating W^^, we use Eq. (O, and finally obtain: 



{c^Y = 



Bi e^^'' + 2B2e^'' +Bj, 
^{{2 + XA)e^^ -XA-\ 



-1, 



(32) 



Alexander K. Vidybida, Kseniya G. Kravchuk: Output Stream of Inhibitory Binding Neuron 




I'^^i* 



/V^» 



0.02 0.04 0.06 0.08 0.1 
ISI duration, s 



^**''*>*MW, 



0.02 0.04 0.06 O.C 
ISI duration, s 



where 



3e 



-AXA 



-3A4 



-2(6A4 + 13)e 



-2XA 



-8(2A4+3)e 



-A/i 



12A''zi^ + 52Azi+51, 



-4(2A4- 



-AlA 

-3)e 



_^4g-3A4 +2(-5A4 +AT-7) g-^A/i^ 
^^ - 12A2zi2 +4A24T-34Azi +6AT-24, 



1 



4=0 {2e^^-\) 



At 



2e^'^V2(AT-l)e''^ + l 



where cj! was previously found in lfT9l . 
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Fig. 7. ISI probability density (measured in s^ ), found numerically. 
Left - BN with delayed feedback for A'g = 2, T = 10 ms, 4 = 18 ms, 
A = 50 s^^, 5 ■ 10^ triggerings in Monte-Carlo method; right - LIF 
neuron with delayed feedback for C = 20 mV, T^ = 3 ms, 4 = 18 ms, 
yo = 15 mV, A = 75 s^' , 5 ■ 10^ triggerings in Monte-Carlo method. 



B3 = e-4^^ + 2(4Azi + 3) e-'^^^ + llX^A^ + 24Azi + 9. 

(33) 

It is clear, that for 4=0 Eqs. ( |32] ). ( |33] | must give the output 
ISI coefficient of variation of BN without feedback, c^. And 
indeed, substituting 4 = to ( |32] | and ( |33] |. one obtains 



{^ 



7 Numerical Simulations 

We have also performed numerical simulations of inhibitory 
BN with delayed feedback. A C-n- program developed is sim- 
ilar to that used for excitatory BN with delayed feedback|20|. 
The class of objects, which reproduce the operation manner 
of inhibitory BN with delayed feedback, was created. Object 
of this class receives the sequence of pseudorandom numbers 
with Poisson distribution to its input, which is realized using 
tools from the GNU Scientific LibrarjQ 

BN firing statistics is represented in terms oiP^{t\ f{s), 
Xg and c^ . Numerical results obtained are then compared with 
corresponding analytical expressions, given in Eqs. (l20l i. ( |23] | - 
(|27] |. (fT6] l - ^3, ® , ^ and ^. It was found, that numer- 
ically obtained curves fit perfectly with mentioned analytical 
expressions, see example in Fig. [3] 

Also the set of numerical simulations for BN with higher 
threshold as well as for the case A > T was performed. All 



http://www.gnu.org/software/gsl/ 



Fig. 8. ISI probability density P {t) (measured in s^') found numer- 
ically for T = 10 ms, 4=8 ms, A = 50 s" ' . Left — Nq = 4, right — 
Nq = 6. In both cases 3 ■ 10^ triggerings were taken. 



the ISI probability densities found are similar to those obtained 
analytically for threshold 2 and A < T, see Figs.|7] left and[8] 

In order to omit the model limitations and to figure out, 
what pequliarities of the ISI probability density are caused namely 
by the presence of delayed feedback, we have also performed 
numerical simulations of an inhibitory leaky integrate-and-fire 
(LIF) neuron with delayed feedback. Namely, the LIF neuron is 
characterized by a threshold, C, and every excitatory input im- 
pulse advances by yo the LIF membrane voltage, V. Between 
input impulses, V decays exponentially with time constant Tm- 
The LIF neuron fires when V becomes greater or equal C, and 
V = just after firing. When the inhibitory impulse arrives, 
it resets neuron's membrane potential to zero. The LIF model 
doesn't allow exact mathematical treatment due to gradual ex- 
ponential decay of input impulses. 

Thus, the program developed was extended with the class 
of objects, which mimics the operation manner of inhibitory 
LIF neuron with delayed feedback. The objects of this class are 
fed externally with the same sequence of pseudorandom num- 
bers (input ISIs) as the objects of the class, based on the BN 
model. It was found for several parameter sets, that obtained 
ISI distribution for LIF model is qualitatively similar to what 
was found for the BN model, see example in Fig.|7] right. 



8 Discussion and Conclusions 

We investigated here the firing statistics of a single inhibitory 
neuron with delayed feedback under Poisson stimulation. Us- 
ing binding neuron model, we calculate analytically the output 
ISI probability density, as well as the mean output ISI and the 
coefficient of variation for the threshold 2. For higher thresh- 
olds, mentioned statistical properties are found numerically by 
means of Monte-Carlo simulations. 

In order to elucidate whether the features of neuronal firing 
statistics found are due to the the BN neuron model specifics, 
or namely due to the delayed feedback presence, the numer- 
ical simulations of a single inhibitory leaky integrate-and-fire 
neuron with delayed feedback were also performed. The LIF 
neuron was driven externally with the Poisson stream, which is 
the same as for BN. 

The ISI probability densities found both for inhibitory BN 
and inhibitory LIF neuron exhibit several qualitatively simi- 
lar pequliarities. Namely, for all the parameters sets, the P'^{t) 
are found to be bimodal functions, which contain jumps and 
derivative discontinuities, see Figs. [3] Hand [8] 
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Fig. 9. ISI probability density P^ (t), s"' . Left - BN without feedback 
II8I ; right - for excitatory neuron BN with delayed feedback 1 20|. In 
both cases, x = 10 ms, A = 50 s^\ A'o = 2. For right pannel, A = S 



Break, or jump, in ISI probability density at f = Zi is caused 
by the assumption of fixed time delay A of the impulse in the 
feedback line. Breaks of the same nature were observed before 
both for excitatory BN and excitatory LIF neuron with instan- 
taneous | 19 | and delayed feedback |20|. 

The derivative discontinuities in ISI probability density are 
due to the time decay of the traces of inputs in neuron's mem- 
ory, which is true both for BN and for LIF models. Such deriva- 
tive discontinuinies were found in the case of no feedback, and 
also both for excitatory neuron with instantaneous and for ex- 
citatory neuron with delayed feedback. 

In order to get visual impression of how does the delayed 
feedback presence reshape neuron's firing statistics of inhibitory 
neuron as compared to the case without feedback, we have 
placed here the typical output ISI probability density for BN 
without feedback, see Fig. |9] left. The exact expressions for 
this probability density are given in Eq. ([TJ. 

In the absence of feedback, bimodality and breaks in ISI 
probability density are not observed, see Fig. |9l left. One can 
conclude, that it is namely the delayed feedback presence, which 
causes transformation of continuous and unimodal output ISI 
probability density to the bimodal function with jump. 

In Fig. |9] right, the tipycal output ISI probability density 
for excitatory BN with delayed feedback is placed, see ll20l 
for details. In the case of excitatory neuron with delayed feed- 
back, the output ISI probability density is multimodal function, 
which contains singularity of Dirac 5-function type at t ^ A, 
exhibits jumps and derivative discontinuities. Due to the ab- 
sence of 5-shaped peak, the observed number of jumps and 
modes, the ISI probability density for inhibitory BN with de- 
layed feedback can be easily distinguished from the ISI proba- 
bility density for excitatory BN with delayed feedback. 

Also, we calculated here the mean output intensity, or fir- 
ing rate, which is inverse mean output ISI. For inhibitory neu- 
ron, the output firing rate was reduced by the delayed feedback, 
as expected, see Fig. |4] left. For higher thresholds, the range 
of input intensities, at which the output firing is almost im- 
probable, becomes wider, see Fig.|4] right. In other words, the 
higher threshold is the stronger stimulation is needed to evoke 
response. The obtained input-output relationship for BN firing 
intensities resembles those found experimentally for real neu- 
rons under natural stimulation! 5 Fig. 4]. In contrast to the case 
of feed-forward shunting inhibitionL4J, the delayed feedback 
presence was not found to change the sigmoid input-output re- 
lationship qualitatively. 



As regards the output ISI coefficient of variation, the con- 
siderable variability of output ISIs was found both for inhibitory 
BN and inhibitory LIF neuron with delayed feedback. CV was 
found as the function ranging between 0.5 and 1, see Figs.|5]and 
|6] This is consistent with experimental results 1,7. . 13,1 . where 
high CV values of the same range were obtained at the output 
of cortical neurons. 

From Fig. |6]one can see, that delayed feedback influences 
CV for both BN and LIF neuron in a similar manner. In con- 
trast to the case of excitatory neuron with delayed feedback, 
the delayed feedback presence does not change CV values of 
inhibitory neuron substantially as compared to the case with- 
out feedback. This is in accordance with experimental studies 
of the influence of independent GABA-mediated inhibition on * 
CV value of cortical neuronsfS 14|. 

We conclude, that the output firing statistics of an inhibitory 
neuron undergoes substantial changes due to the action of de- 
layed feedback. These changes are qualitatively distinct from 
those, imposed by the delayed feedback on excitatory neuron. 
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